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(57) Abstract 

Apparatus and methods are disclosed for generating individualized medical profiles based on information provided by a patient(2 10), 
and on data extracted from medical literature (206), in a first stage, medical literature (206) is selected for inclusion in a database (22) by 
using specified inclusion criteria. Information on input parameters (44) of the studies, and algorithms contained in the studies is extracted 
from the literature, and stored in a database (22). In a second stage, patients provide information (210), which is matched against the input 
parameters (44) of the studies in the database (22), and algorithms from the matched studies are applied to the information provided by 
the patient to produce values for the output parameters (45). Combination analysis is used to combine the values of output parameters into 
"super-category" values, that are used to generate an individualized medical profile. 
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AUTOMATED PROFILER SYSTEM FOR PROVIDING 
MEDICAL INFORMATION TO PATIENTS 

Field Of The Invention 

The present invention relates generally to 
5 methods and apparatus for collecting medical data, and 
for providing a patient with customized access to the 
data. More specifically, the present invention 
provides a computerized profiler system for building a 
medical database from medical literature, and 
10 automatically generating personalized profiles based on 
information provided by a patient and medical data 
stored in the medical database. 

Background Of The Invention 

As medical information resources have become 

15 easier to access," the public demand for such resources 
has increased. The Internet has enabled millions of 
users worldwide to access an ever-growing selection of 
medical information, and has resulted in patients 
becoming increasingly knowledgeable about their medical 

20 conditions. Additionally, the Internet has provided 
patients with access to world-wide on-line communities 
of individuals with similar medical conditions, who are 
able to share their experiences and advice. 
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While this increase in the availability of 
medical information to patients has had some good 
effects, such as a heightened level of discussion 
between physicians and patients, it also has some 
5 drawbacks. Much of the information available to 

patients over the Internet is unreliable. It is often 
based on individual experiences or opinions, rather 
than on solid medical research. Such material can 
mislead patients, or even cause additional medical 
10 difficulties if unreliable advice is followed without 
first consulting a physician. 

Even medical information provided by reliable 
on-line sources may not be helpful. Much of the 
information that is available is highly technical, and 
15 is not comprehensible to most patients. Reliable 

information that is written for use by patients who do 
not have extensive medical knowledge is often too 
general to be useful, and may not include information 
on the latest research and treatments. Additionally, 
20 almost all of the information available to patients 
over the Internet is generic, in that it is not 
specifically tailored to the individual patient's 
medical conditions . 

At the same time that patients. are gaining 
25 access to medical information, medical knowledge is 

growing at an ever increasing rate. Each month, dozens 
of studies on a variety of diseases and treatments are 
published in numerous credible medical journals. The 
volume of information published each year on some major 
30 diseases, such as cancer, is becoming so great that 

even specialists in the field may be unable to keep up 
with all the latest research. Without knowledge of the 
latest research and technigues, a physician may not be 
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able to render the best possible advice to his or her 
patients. 

This difficulty in rendering the best advice 
is further compounded by the fact that many patients 
5 are becoming more sophisticated in the demands that 
they place on physicians, as discussed above. 
Physicians may have difficulty keeping up with the 
latest information that will be required to satisfy 
knowledgeable patients, who may have detailed questions 
10 pertaining to recent research and techniques. 

There have been many attempts to provide 
automated systems for generating individualized medical 
diagnoses or advice. A couple of recent examples are 
shown in U.S. Patent Number 5,711,297, to Iliff, which 
15 provides automated medical advise to the general public 
over a telephone, and U.S. Patent Number 5,724,580, to 
Levin et al . , which assists physicians by automatically 
generating individualized management and prognosis 
reports . 

20 Typically, these systems ask the patient (or 

physician) a series of questions, or require that data 
about a patient's condition be entered into a computer. 
This information is processed by applying a set of 
rules to the data, which results in the system 

25 generating diagnoses or advice. 

One difficulty with such systems is that the 
rules are often static, and are based on the knowledge 
of one or more physicians, or gleaned from medical 
textbooks on the field to which the rules pertain. 

30 Thus, the rules depend on the specific knowledge of a 
few individuals, or on general medical knowledge, 
rather than being based on the latest research. Since 
the rules tend to be static, either contained in a 
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database of rules. or hard-coded into the system, it may 
be difficult to update the rules based on new research. 

Even in systems where the rules are not 
static, there is no way of entering the results of the 
5 latest medical research, other than updating the rules. 
Since the rules in these systems are typically complex 
and interrelated, a change in one rule may lead to many 
changes in the rule base. Thus, changing a few rules 
to account for the latest research may lead to many 
10 changes in the rules on which a system operates. 

A few systems have rejected a rules-based 
approach, in favor of a more dynamic method. U.S. 
Patent No. 5,586,024, to Shaibani, for example, matches 
accident factors for a current patient against accident 
15 factors from past accidents to diagnose possible trauma 
injuries. By basing a diagnosis on past results, this 
approach permits the system to be automatically updated 
based on its most recent experiences. Since the system 
is not rule-based, it is not necessary to derive and 
20 enter a complex set of rules. However, because the 
system described in Shaibani depends on experience, 
rather than knowledge, reports generated by the system 
are not based on medical research. 

Both rules-based systems and those that use 
25 some other approach typically focus on providing a . 
medical diagnosis or medical advice, rather than on 
providing medical information. Rather than attempting 
to augment the patient's or physician's knowledge, most 
known systems attempt to replace or augment a 
30 physician's judgement in making a diagnosis. For 
example, most systems do not provide citations to 
medical papers that may be helpful or relevant to the 
individual patient or his/her physician. 
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In view of the above, it would be desirable 
to provide an automated system that generates 
individualized medical information for a patient based 
on information provided by the patient, and on 
5 knowledge extracted from medical research literature. 

It would further be desirable to provide 
methods and structures for extracting and storing 
useful results or other information from medical 
literature . 

10 It also would be desirable to provide 

automated methods for applying medical knowledge stored 
in a medical database to provide a patient with 
individualized information on a variety of treatment 
options that may be discussed with a physician. 

15 Summary Of The Invention 

It is an object of the present invention to 
provide an automated system that generates 
individualized medical information for a patient based 
on information provided by the patient, and on 

20 knowledge extracted from medical research literature. 

It is a further object of the present 
invention to provide methods and structures for 
extracting and storing useful results or other 
information from medical literature. 

25 It also is an object of the present invention 

to provide automated methods for applying medical 
knowledge stored in a medical database to provide a 
patient with individualized information on a variety of 
treatment options that may be discussed with a 

30 physician. 

These and other objects of the present 
invention are achieved by providing a system that 
stores information extracted from medical literature in 
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a medical database, and uses the information in the 
database, along with information provided by a patient, 
to generate an individualized medical profile, 
containing information on available treatments, as well 
5 as information on the medical literature that was used 
to generate the treatment information. 

In a preferred embodiment of the system of 
the present invention, a medical database is stored on 
a server computer, and patients interact with the 

10 server computer over the Internet. A user connects to 
the system over the Internet using a standard web 
browser, and interacts with the system by filling out 
one or more forms that request specific information 
from the user. The system then uses a medical 

15 database, built using information from the medical 

literature, to generate an individualized profile for 
the patient. In a preferred embodiment, the 
individualized profile is displayed in the web browser, 
and the patient may select links in the individualized 

20 profile to access more detailed information on the 
medical literature that was used to generate the 
profile. 

The system of the present invention includes 
two major components: extraction of information from 

25 medical literature to build a medical database; and a 
series of programmed routines that use the medical 
database, along with information provided by a patient, 
to generate an individualized profile. 

Preferably, an editorial review board made up 

30 of specialists in numerous medical fields is assembled 
to review and score medical literature for inclusion in 
the medical database. Based on predetermined criteria, 
the review board determines which papers and studies 
should be used to generate a database of medical 
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information for a specific disease state, e.g., 
prostate cancer. The review board continually 
evaluates new medical literature, and adds new studies 
to the medical database. In this way, the information 
5 in the medical database is continually updated to 
reflect the latest research. 

Studies that are accepted for inclusion in 
the database go through a data extraction process in 
which useful information and algorithms from the papers 

10 are extracted and stored in various tables in the 

medical database. Input parameters, output parameters, 
data tables, information on the study population, 
statistical information, and any appropriate algorithms 
employed in the paper, together with an abstract, and 

15 citation information are extracted from each study. 
Additionally, each study is assigned an output 
category, based on the function served by the output of 
the study, a treatment category, based on the treatment 
applied in the study, and a combination rule, which is 

20 used to combine output from the study into "super- 
categories". All of this information, as well as 
information on available treatments and their 
indications are stored in the medical database. 

The second component of the system comprises 

25 a series of programmed routines constructed in 

accordance with the present invention that use the 
medical database to generate customized profiles for 
patients. A patient provides various personal and 
clinical information to the system as input. If there 

30 is any missing information, the system provides a 

missing information report to the patient. Next, the 
database is used to match the available information 
against the input parameters for each of the studies in 
the medical database. Algorithms or tables extracted 
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from all studies for which the input parameters were 
matched are applied to the information provided by the 
patient to generate output data. Combination analysis 
is then performed on the output data to combine the 
5 output from the various studies into predetermined 
"super-category" values . 

Next, information on treatments and their 
indications stored in the medical database is applied 
to the information provided by the patient, and to the 

10 "super-category" values, to determine which treatments 
are most applicable. For each of the treatments, the 
information provided by the patient, as well as the 
combined 11 super-category" values, and the output from 
the studies are used in conjunction with the studies in 

15 the medical database that pertain to the outcome of the 
treatment to generate information on the probable 
outcome of each treatment. 

All of the information on the input provided 
by the' patient, the output data from the studies, the 

20 "super-category" values, the indicated treatments, the 
probable treatment outcomes, and the studies that were 
applied are combined to generate a personalized 
profile. The personalized profile is then made 
available to the patient. The patient is advised to 

25 discuss the profile with a physician, who may be able 

to assist the patient in assessing the profile, and may 
provide additional information to the system. As the 
patient adds or changes the input data, the system may 
be employed to generate updated personal profiles. 

3 0 Brief Description Of The Drawings 

The above and other objects and advantages of 
the present invention will be apparent upon 
consideration of the following detailed description, 
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taken in conjunction with the accompanying drawings, in 
which like reference characters refer to like parts 
throughout/ and in which: 

FIGS 1A and IB are overviews of the two major 
5 components of the system of the present invention; 

FIG. 2 is a detailed flowchart of the method 
for selecting studies for inclusion in the medical 
database; 

FIG. 3 is an overview of the structure of the 
10 literature dataset in the medical database; 

FIG. 4 shows the structure of a record in the 
study table of the literature dataset in the medical 
database ; 

FIG. 5 shows the structure of a record in the 
15 input parameters table of the literature dataset in the 
medical database; 

FIG. 6 shows the structure of a record in the 
output parameters table of the literature dataset in 
the medical database; 
20 FIG. 7 is an illustrative example of the 

output parameters and super-categories associated with 
an output category; 

FIG. 8 is a flowchart of the data extraction 

process ; 

25 FIG. 9 shows the structure of a record in the 

treatment indications table in the medical database; 

FIG. 10 is a flowchart of the process for 

generating input forms and obtaining values for input 

parameters from a patient; 
30 FIG. 11 is an illustrative example of a 

portion of an input form; 

FIG. 12 is a flowchart of the process for 

generating output parameter values and "super-category" 

values from the input parameter values; 
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FIG. 13 is a flowchart of the method for 
generating treatment options; 

FIG. 14 is a flowchart- of the method for 
generating information on the probable outcome of 
5 treatments, and for generating the profile; and 

FIG. 15 shows an illustrative computer 
network on which the database and methods of the 
present invention may be implemented. 

Detailed Description Of The Invention 

10 The present invention provides a system for 

generating individualized disease and treatment 
profiles for patients. The system comprises two 
stages: a first stage, in which medical data are 
collected from numerous sources to assemble a medical 

15 database; and a second stage, in which the database is 
used in conjunction with information provided by a 
patient to generate individualized profiles. The 
system is described hereinbelow using an example 
embodiment for gathering data on prostate cancer, and 

20 for providing individualized reports to prostate cancer 
patients. It will be apparent to one skilled in the 
art that the system is general, and could be readily 
applied to nearly any disease or medical condition. 

Definitions 

25 For the purpose of describing the system of 

the present invention, it is useful to define several 
terms. As used hereinbelow,- a "study" refers to the 
results of medical research, typically involving 
numerous human subjects. A study has input parameters, 

30 which identify the variable factors in the study, and 
output parameters, which identify factors that are 
affected by variation in the input parameters. A study 
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can be seen as defining a function or algorithm that 
maps values of the input parameters to values of the 
output parameters . 

As used hereinbelow, a "paper" is a 
5 publication or other source of medical information that 
contains one or more studies. Papers are typically 
published in medical journals, but also may come from 
other sources, such as conference proceedings, 
textbooks, tutorials, research reports, or any other 

10 type of medical literature. 

A database, as used hereinbelow, is a 
compilation of data stored on a computer system. A 
database may contain datasets and tables. A dataset is 
a collection of related data, and may contain one or 

15 more interrelated tables. A table is also a set of 

related data organized into one or more fields. Each 
field identifies a specific piece of data, such as a 
unique identifier, or a description. Some fields may 
contain references to other tables in the database, to 

20 entire datasets, or to specific records or fields in 
any table in the database. Additionally, fields may 
contain pointers to data stored in other databases, 
available either on the same computer, or accessible 
over a network. 

25 A unit of data in a table is referred to as a 

record. Thus, a record in a particular table comprises 
data populating each of the fields associated with the 
table. A record set is a grouping of records, such as 
all the records of a particular table, or all the 

30 records that match a particular query. 
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Overview 

Referring to FIG. 1A, an overview of a first 
stage of a system constructed in accordance with the 
principles of the present invention is described. In 
5 this stage, medical data are collected to create a 

medical database. Peer-reviewed papers 20 are provided 
to an editorial review board, which reviews papers 20 
at step 200 to determine which papers should be 
included in the database. 
10 At step 202, each individual paper that has 

been reviewed is checked to see if it meets 
predetermined inclusion criteria, and should be 
included in the database. If the paper does not meet 
the inclusion criteria, the review of the paper is 
15 archived at step 204, and the paper is not included in 
the database. Otherwise, if the paper meets the 
inclusion criteria, information on any studies 
contained in the paper is extracted in step 206, and 
the extracted information is stored in database 22. 
20 Once a sufficient quantity of medical data is 

available in database 22, a second stage of the system 
of the present invention, described with respect to 
FIG. IB, may be used. This second stage permits 
individualized profiles to be generated for patients, 
25 based on information provided by the patients and on 
. the data in database 22. 

At step 210, the patient collects a variety 
of clinical information, such as results of medical 
tests, and information provided by a physician. At 
30 step 212, the patient provides this clinical 

information, as well as demographic information, and 
information relating to quality of life issues to a 
computer executing software designed in accordance with 
the principles of the present invention. The 
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information is provided through an interactive process, 
e.g., by having the patient visit an Internet site. 
Alternatively, the patient may interact with the 
computer over a telephone, using voice or touch-tone 
5 commands, or through fax or mail, by sending forms 
containing the information. Data provided by the 
patient is stored in a patient dataset in database 22. 

At step 214, the system evaluates the data 
provided by the patient to determine if there is 
10 sufficient data to produce an individualized profile. 
If the system determines that there is not yet enough 
patient data, it generates a "missing data report," at 
step 216, which is sent to the patient, e.g., as either 
an additional screen display, e-mail message, or 
15 computer-generated form mailing. The missing data 

report tells the patient what data is needed before a 
profile may be generated. 

When the patient has provided sufficient 
information, the system uses the information in step 
20 218, along with medical data from database 22, to 
generate an individualized profile. The profile 
contains assessments of available treatment options, 
any common complications associated with each of the 
treatment options, and the likely results of each of 
25 the options when applied to the individual patient. 
Additionally, the profile may contain information on 
quality of life issues related to each of the treatment 
options, and information on the experiences of other 
patients who have used each option. 
30 In a preferred embodiment, the completed 

profile is sent to the patient over the Internet, in an 
interactive format that permits the patient to request 
further information, or specific details of the report. 
Alternatively, the report may be sent over the Internet 
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in a non-interactive format, such as e-mail, or via 
fax, or through the mail- At -step 220, the patient 
reviews the report with his or her physician. As 
additional clinical information is collected, or if the 
5 patient's condition changes or progresses, this 

information may be provided to the system (step 222), 
which can then generate updated profiles by repeating 
the above-described process. 

STAGE I : BUILDING THE MEDICAL DATABASE 

10 Study Selection 

Referring to FIG. 2, a preferred procedure 
for reviewing papers, and for deciding which papers 
should be included in database 22 is described. 
Medical papers 30 are gathered and reviewed by medical 
15 editorial board 32. Medical editorial board 32 

comprises reviewers 33a-f, each of whom is preferably a 
medical expert or specialist in a field of medicine 
related to the specific disease and treatments for 
which database 22 is being constructed. Additionally, 
20 each medical editorial board preferably includes at 
least one pathologist, and a statistician. In an 
illustrative embodiment in which database 22 contains 
data on cancer, numerous medical editorial boards, one 
for each major cancer type (e.g. prostate, breast, 
25 bladder, etc.), will be assembled. The medical 

editorial board for prostate cancer, for example, may 
include specialists such as urologists, uro- 
pathologists, seed implant specialists, medical 
oncologists, radiation oncologists, and statisticians. 
30 Each medical review board 32 is responsible 

for locating and reviewing papers that may be included 
in database 22. During an initial review, papers that 
contain information or studies that may be useful are 
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identified as candidate papers. Each candidate paper 
or study is then reviewed for inclusion, preferably 
using the following inclusion criteria: 

(1) Are the objectives of the paper clearly 



equation?; and 

(7) If this paper does not meet the criteria 
above, should it be marked as "experimental but 
useful" (EBU)? Papers marked as EBU will be 
20 included in the database, but not included in the 

final analysis process. 

Based on the foregoing inclusion criteria, 
members 33a-f of medical editorial board 32 prepare 
summaries 35a-f for each paper or study. These 
25 summaries contain written report's and clinical utility 
reports for each paper or study, and assign each paper 
or study a numerical score, preferably ranging from 1 
to 5. In a preferred numerical rating system, a score 
of 1 indicates that the paper is useless, a score of 2 
30 indicates that the paper does not contain sufficient 
study data, a score of 3 indicates that the paper 
contains sufficient study data, a score of 4 indicates 
an excellent paper, and a score of 5 indicates that the 
paper sets the standard of care for the disease in 



5 



stated and understood by the reviewer?; 

(2) Is the study population detailed adequately 
in the materials section?; 

(3) Are the methods described well enough to 
reproduce the experiment or investigation?; 

(4) Can the reviewer assess the results based on 
the data provided?; 

(5) Has there been a statistical evaluation of 
the data that shows statistical significance?; 

(6) Are there results that are statistically 
significant that can be summarized in a table or 



10 



15 
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question. Summaries 35a-f are stored in database 22, 
with the written reviews, numerical scores, and 
clinical utility reports for each paper or study being 
stored in a written review dataset, a score dataset, 
5 and a written clinical utility dataset, respectively. 

At step 230, the numerical scores from 
summaries 35a-f are averaged. If the average score is 
3 or greater (step 232), the paper is marked for 
inclusion in database 22, and for use in the analysis 

10 process (step 234). Papers that receive an average 

score lower than 3 are checked to see if the majority 
of the reviewers marked the paper as "Experimental but 
Useful" (EBU) (step 236) . If so, the paper is included 
in database 22 (step 238), but will not be used in the 

15 analysis process. Papers that did not receive a score 
of 3, and that are not EBU are rejected at step 239. 

Once the useful papers have been identified, 
data must be extracted from them to be placed in 
database 22, and to be used in the analysis process. 

20 Before describing the extraction process in detail, it 
is necessary to describe the structure of the datasets 
and tables in database 22 in which the data from the 
papers and studies are stored. 

Structure of the Literature Dataset 
25 Referring to FIG. 3, a high-level overview of 

literature dataset 36 of database 22 is described. 
Literature dataset 36 preferably includes study table 
37, containing data related to the medical studies 
stored in database 22. Study table 37 includes fields 
30 that point to input parameters table 38, which stores 
data on the input parameters associated with each 
study, and output parameters table 39, which stores 
data on the output parameters of each study. 
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FIG. 4 shows the anatomy of a record in study 
table 37 of literature dataset 36 in database 22. 
Study record 40 has data in fields representing the 
input parameters of the study, the output parameters of 
5 the study, tables and calculations provided by the 
study, the study's output and treatment categories, 
citation information, and a patient-readable abstract 
of the study. 

Identifier field 41 contains a unique 

10 identifier for each record in study table 37. Fields 
in other tables that reference records in study table 
37 may use the values stored in identifier field 41 to 
point to a particular record in study table 37. 

Citation information field 42 contains 

15 information on the title of the paper or study, the 
author, the journal in which the study appeared, the 
page numbers in the journal, the publication date, or 
any other information that is needed to identify the 
source from which the data in a study record was 

20 extracted. As will be understood by one skilled in the 
art, this field may either contain all these items 
directly (as sub-fields), or, in a preferred 
embodiment, may point to records in a "literature 
citation" table (not shown) having fields for the 

25 various parts of the citation information. 

Patient readable abstract field 43 contains 
the text of an abstract ,of the study from which the 
data in study record 40 was extracted. This abstract 
may be displayed or printed as part of an 

30 individualized profile, to provide the patient with 

information on the papers or studies that were used to 
prepare the profile. 
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Input parameters field 44 contains a list of 
one or more input parameters for the study. Each entry 
in the list points to a record in input parameters 
table 38, described in greater detail hereinbelow. It 
5 should be noted that numerous study records may point 
to the same input parameter. Thus, for example, if 
numerous studies require an input parameter 
representing the percent of cancer in a biopsy, the 
records for all of these studies may point to a single 
10 "percent of cancer in biopsy" record in input parameter 
table 38. 

Output parameter field 45 contains a list of 
one or more output parameters for the study, each of 
which points to a record in output parameters table 39, 

15 described in detail hereinbelow. Although multiple 
studies may point to the same record in output 
parameter table 39, due to subtle variations in the 
precise meaning of the "same" output parameter in 
different studies, this may be less common than for 

20 input parameters. 

Output tables field 46 contains zero or more 
tables that specify algorithms for mapping values of 
input parameters to values of output parameters. These 
tables are derived from the study, and may be multi- 

25 dimensional, providing a value for an output parameter 
based on the values of multiple input parameters. 
Additionally, as will be understood by one skilled in 
the art, structures such as neural networks or fuzzy 
logic algorithms may be represented in tables. When 

30 the results of a study are amenable to using such 
techniques, the tables representing the necessary 
structures may be stored in output tables field 46. 
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Similarly, output calculations field 47 
contains zero or more calculations derived from the 
study that specify algorithms for mapping values of one 
or more of the input parameters to values for one or 
5 more of the output parameters- The results from some 
studies are better represented by a function or 
calculation than by a table. These functions or 
calculations, preferably represented as code for 
computing the function, are stored in output 

10 calculations field 47. The code stored in output 

calculations field 47 may be written in any computer 
language in which mathematical functions may be 
expressed, such as C++, Java or Javascript. 
Additionally, it should be noted that for studies that 

15 are useful in generating individualized profiles, 

either output calculations field 47 or output tables 
field 45 should contain at least one entry. 

Output category field, 48 contains the 
identifier of an output category to which the study is 

20 directed. For example, in a system for providing 
profiles to prostate cancer patients, a study that 
addresses determination of the pathologic stage of the 
cancer would have a "staging" output category, whereas 
a study directed to predicting disease free survival 

25 would have an "outcome" output category. The available 
output categories for an illustrative prostate cancer 
system should preferably include a staging category, 
for studies directed to determining the pathologic 
staging of the cancer; an outcome category, for studies 

30 directed to predicting disease free survival or PSA 
recurrence; a quality of life category, for studies 
directed to quality of life issues, such as 
incontinence or impotence; a complications category, 
for studies directed to complications "-that may occur as 
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a result of treatment; and an alternatives category, 
for studies relating to alternative and integrative 
medicine. 

Treatment category field 49 contains 
5 information on any treatment that the study population 
received. This information permits the output category 
to be related to the treatment. For example, a study 
may provide information on the 36 month disease free 
survival rate for patients who underwent radical 
10 prostatectomy. For this study, the output category 
would by "outcome 1 ' (see above) , and the treatment 
category would be "radical prostatectomy." Treatment 
categories for the prostate cancer example system 
preferably include radical prostatectomy, seed 
15 implants, chemotherapy, cryotherapy, external beam 

radiation, conformal beam radiation, watchful waiting, 
hormonal blockade, alternative, and hyperthermia. 

Statistical field 50 contains any statistical 
information found in the study. Studies may, for 
20 example, contain information on p-values, the mean 
value of a parameter within the study population, 
standard deviation, population distribution, the median 
within the study population, the sensitivity, or the 
specificity. . Any such information relating to study 
25 statistics should be stored in statistical field 50. 

Combination rule field 51 identifies the 
combination analysis method that will be used to 
combine output parameters into a super-category value 
(described hereinbelow) for this study. Combination 
30 analysis methods may include simple methods, such as 

averaging, more complex methods, such as fuzzy logic or, 
fuzzy sets, statistical methods, such as meta-analysis, 
or interactive techniques. The availability of some of 
these techniques may depend on. the nature of the 
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statistical information that is available in 
statistical field 50. For example, for meta-analysis 
to be used, statistical field 50 must include either p- 
values, means and standard deviations, or population 
5 distributions. 

Study population field 52 contains 
information on the group of subjects on whom the study 
was conducted. As a minimum, study population field 52 
contains the size of the study population. For 

10 example, if the study was conducted using a population 
of 780 people, study population field 52 would contain 
780 as the size of the study population. This 
information is used when generating reports. 

FIG. 5 shows the structure of a record in 

15 input parameters table 38 of literature dataset 36 of 
database 22. Records in input parameters table 38 are 
used to describe the input parameters of studies. 
Input parameter record 55 preferably includes fields 
containing an input parameter identifier, the display 

20 type for the input parameter, a glossary term and 
description of the input parameter, code for 
displaying, validating, and reconstructing values of 
input parameters, information on which input forms are 
used to obtain values for the input parameter, and 

25 available selections or options for the input 
parameter . 

Identifier field 56 contains a unique 
identifier for each record in input parameters table 
38. Fields in other tables (such as study table 37) 
30 that reference records in input parameters table 38 may 
use the values stored in identifier field 56 to point 
to a particular record in input parameters table 38. 
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Name field 57 contains the name of the input 
parameter. This name will be displayed on an input 
form used for gathering information from a patient. 

Glossary term field 58 contains the text of a 
5 detailed description of the input parameter that may be 
used to assist a user in providing values for the input 
parameter. Similarly, description field 59 contains 
the text of a short description of the input parameter, 
for users in need of quick help. As will be described 
10 in greater detail hereinbelow, the text in description 
field 58 may pop up automatically in an input form that 
is used to provide a value for the input parameter. 

Display type field 60 contains information on 
the display type of the input parameter. For example, 
15 the input parameter might be a percentage, a date 

(mmddyy), a yes or no answer, an integer, or any other 
type. Display type field 60 identifies the type .of the 
input parameter. 

Display code field 61 contains code, e.g., 
20 written in HTML, for displaying the input parameter on 
a web page or form. When it is necessary to display an 
input parameter, the display code for that parameter is 
executed . 

Validation code field 62 contains code, e.g., 
25 written in Javascript, for validating an input 

parameter. When a user enters a value for an input 
parameter, the validation code is executed to make sure 
that the user has entered a valid value for the 
parameter. For example, if an input parameter is 
30 expressed as a percentage, the valid values range from 
0 to 100. If a user entered 470, the validation code 
would reject the input. In some cases, the validation 
code also converts data entered by the user into an 
internal format. For example, a user , may enter a date 
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as three separate numerical values a month, day, and 
year. Since a date may be stored internally as a 
single number, the validation code must convert the 
format of the user's input (three values) to the .single 
5 number representing the date entered by the user. 

Reconstruction code field 63 contains code, 
preferably written in Javascript, for converting values 
of the input parameter from an internal format to a 
format for display. Thus, using the date example, the 
10 reconstruction code may be executed to convert a date 
that is stored internally as a single number into three 
numbers, a month, day, and year. Typically, the code 
contained in reconstruction code field 63 is executed 
whenever the value of the input parameter must be 
15 displayed. If the value is being displayed on a web 
page or form, the code is executed before the code 
contained in display code field 61 . 

Advantageously, these code fields permit all 
the code necessary to display, validate, and 
20 reconstruct the input parameter to be encapsulated with 
other data on the input parameter in database 22. 
Thus, an input parameter may be seen as an object that 
"knows" how to display itself, how to "check its input 
for valid values, and how to convert itself between 
25 internal formats and user-readable formats. This also 
permits the system to automatically generate forms for 
use in gathering information from patients, as will be 
described in greater detail hereinbelow. 

Selections field 64 contains a list of 
30 selectable values for the input parameter if the input 
parameter is of a type for which such selectable values 
are appropriate. For example, if the input parameter 
is a "True" or "False" selection, selections field 64 
will contain a selection for true, and- a selection for 
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false. Similarly, an input parameter associated with 
quality of life could have selections for "incontinence 
is acceptable", "incontinence should be avoided", and 
"incontinence is unacceptable." Selections in 
5 selections field 64 are each associated with a value 

for the input parameter, and will appear in a drop-down 
list in a user input form. 

Form(s) ID field 65 contains a list of one or 
more forms on which the input parameter should be 

10 included. Each of the input parameters may appear on 
one or more user input forms. Examples of forms for 
the prostate cancer system include a blood tests form, 
a doctor's exam form, an imaging workup form, a 
demographics form, a quality of life issues form, and a 

15 comorbid issues form. In addition to storing 

information on the forms in which an input parameter is 
included, a separate table (not shown) for each form 
may be built, including the identifiers of each of the 
input parameters that are included in the form, and the 

20 order in which the input parameters appear. This 

information is used to generate user input forms, as 
described hereinbelow . 

Table 1 contains an illustrative list of 
input parameters used by an illustrative system 

25 constructed in accordance with the present invention 
for generating profiles for prostate cancer patients. 
Many of these input parameters were extracted from . 
literature, while some, such as birth date, doctor 
name, telephone number, and address, provide 

30 administrative information on the patient. It- will be 
of course be understood that the selection of input 
parameters in input parameters table 33 will vary 
according to the disease being handled by the system, 
and the selection of studies that have .been entered 
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into the system. Thus, the input parameters listed in 
Table 1 are illustrative only, and do not represent all 
possible input parameters that may be used by a 
prostate cancer system, since the list changes as a 
5 result of the dynamic process of adding studies to the 
system. 

Referring to FIG. 6, the structure of a 
record in output parameters table 39 of literature 
dataset 36 of database 22 is shown. Records in output 

10 parameters table 39 are used to describe the output 
parameters of studies. Output parameter record 70 
preferably includes fields containing an output 
parameter identifier, a glossary term and description 
of the output parameter, and a super-category for the 

15 output parameter. 

Identifier field 71 contains a unique 
identifier for each record in output parameters table 
39. Fields in other tables (such as study table 37) 
that reference records in output parameters table 39 

20 may use the values stored in identifier field 71 to 

point to a particular record in output parameters table 
39. 

Name field 72 contains the name of the output 
parameter. This name may be displayed in reports or 
25 profiles to identify the output parameter. 

Glossary term field 73 contains the text of a 
detailed description of the output parameter that may 
be used to assist a user in understanding the meaning 
of output parameters cited in a profile or report. 
30 Similarly, description field 74 contains the text of a 
short description of the output parameter. 

Super-category field 75 contains an 
identifier of the super-category of the output 
parameter.- Multiple studies addressing the same or 
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similar issues may provide output parameters that are 
similar or related, but are not identical. For these 
output parameters to be used in the analysis process, 
it may be necessary to create a "normalized" form of 
5 these output parameters by grouping related output 

parameters into "super-categories." Related groups of 
output parameters all have the same super-category, 
which provides a high level and consistent way for 
treatment rules (described hereinbelow) and profiles to 
10 refer to related output parameters. An example of this 
hierarchy from the "staging" output category in the 
prostate cancer system is described with respect to 
FIG . 7. 

In FIG- 7, top level 80 of the hierarchy 

15 represents the output category. In this example, only 
"staging" is shown, though other output categories also 
may have related super-categories. Middle level 81 of 
the hierarchy shows some of the super-categories 
associated with staging (a more complete list is shown 

20 in Table 2) . The super-categories includes super- 
category 82, containing all output parameters relating 
to whether the cancer is organ-confined, and super- 
category 83, containing all output parameters relating 
- to whether the cancer is locally confined. Bottom 

25 level 84 of the hierarchy contains individual output 
parameters . 

Because "organ confined" output parameter 85 
indicates that the cancer is organ confined, its super- 
category is super-category 72, the "organ-confined" 

30 super-category. Both "capsular perforation" output 

parameter 86 and "seminal vesicle" output parameter 87 
are used to determine whether the cancer is locally 
confined, so both have "locally confined" super- 
category 83 as their super-category. The values from 
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output parameters 86 and 87 may be combined to create a 
single "normalized" value for super-category 83, which 
may be reported in a profile, or used to indicate a 
treatment . 

5 Table 3 contains an illustrative list of 

output parameters used by an exemplary system of the 
present invention for generating profiles for prostate 
cancer patients. All of the output parameters were 
extracted from studies. Although there are multiple 

10 output parameters with the same name (e.g. 12 Month 

DFS) , these are different output parameters. This is 
due to differences between studies as to the meaning of 
output parameters having the same name. Many (but not 
all) of the output parameters that have the same name 

15 are similar, or closely related to each other, and 
therefore have the same super-category. 

Of course, the selection of output parameters 
in output parameters table 39 will vary according to 
the disease being handled by the system, and the 

20 selection of studies that have been entered into the 

system. Thus, the output parameters listed in Table 3 
are illustrative only, and do not represent all 
possible output parameters that may be used by a 
prostate cancer system. 

25 It further will be understood that many of 

the fields of the study table, the input parameters 
table, and the output parameters table may be 
implemented using pointers to records in tables that 
associate information with ID numbers, rather than 

30 using the information itself. For example, the super- 
category field of records in output parameters table 39 
may contain the ID numbers of super-categories, rather 
than the names of the super-categories themselves. The 
names of the super-categories may then, be listed in a 



WO 00/55751 



PCT/USOO/06625 



separate table (not shown) , in which the names of the 
super-categories are associated with ID numbers. Most 
any of the fields in the above-described tables, with 
the exception of identifier fields, may be implemented 
5 in this manner. 

Extraction Of Data From The Literature 
Referring to FIG. 8, a preferred method for 
extracting data from studies into database 22 is 
described. Studies 90 that have met the inclusion 

10 criteria are put through the above-described data 

extraction process (see FIG. 2), in which the relevant 
data are extracted into a record in study table 37 for 
inclusion in database 22 (see FIG. 3) . 

At step 241, a new study record, as described 

15 hereinabove with reference to FIG. 4, is prepared to 
contain information on the study from which data are 
being extracted. This includes assigning the study 
record a unique ID number, which is stored in the 
identifier field of the study record. 

20 At step 242, the citation information, such 

as the author and publication date for the study is 
extracted, and placed in the citation information field 
in the study record. 

At step 243, an abstract is prepared for the 

25 study, and is placed in the patient readable abstract 
field of the study record. The abstract may be copied 
directly from the paper in which the study appeared, if 
the paper 1 s abstract is suitable for use by a patient. 
Alternatively, if the paper's abstract -is deemed too 

30 complex for patient use, a new abstract for the study 
may be prepared. 
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At step 244, input parameters for the study 
are extracted, and pointers to the extracted input 
parameters are placed in the input parameters field of 
the study record. If an extracted input parameter is 
5 identical to an existing input parameter that has 

already been extracted from another study, a pointer to 
the existing input parameter record may be used. 
Otherwise, a new input parameter record, as described 
hereinabove with reference to FIG. 5 must be created, 

10 and the fields of the new input parameter record must 
be populated with information on the input parameter. 
Populating the fields of an input parameter record may 
require a skilled technician or scientist to decide on 
appropriate selections for the input parameter, to 

15 decide in which input forms the input parameter should 
be included, and to write the display code, validation 
code, and reconstruction code for the input parameter, 
if necessary. 

In step 245, the output parameters for the 

20 study are extracted, and pointers to the output 

parameters are placed in the output parameters field of 
the study record. Generally, differences between 
studies require that the output parameters from each 
study be separately extracted, even if the output 

25 parameters are nearly identical. Thus, it is typically 
necessary to create a new output parameter record, as 
described hereinabove with reference to FIG. 6, for 
each output parameter extracted from a study. 

It is then necessary to populate the fields 

30 of the output parameter record with information 

extracted from the study, or selected by the technician 
or scientist who is extracting the output parameter. 
Some expertise may be required to assign the proper 
super-category to an output parameter.-. Additionally, 
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it may be necessary to create new super-categories if 
there is no existing super category that is appropriate 
for the extracted output parameter. 

At step 246, any output calculations or 
5 output tables associated with the study are extracted, 
and placed in the output calculations or output tables 
fields of the study record. . The process of extracting 
calculations and tables from a study may require an 
expert to interpret the study, and prepare calculations 

10 or tables that map values of the study's input 

parameters to values of the study's output parameters. 
Depending on the study, it may be necessary to train a 
neural network and store the neural network in a table. 
The level of expertise and effort required to extract 

15 calculations and tables from a study generally will 

vary according to the study. At one end, the study may 
directly provide calculations or tables, which may 
simply be copied. At the other end, expert statistical 
or mathematical analysis may be required to extract the 

20 required calculations or tables. 

In step 247, the study is assigned an output 
category, based on the nature of the study. The 
selected output category is placed in the output 
category field of the study record. 

25 In step 248, the study is assigned a 

treatment category, according to the treatment applied 
to the study population. The selected treatment 
category is stored in the treatment category field of 
the study record. 

30 In step 249, statistical information is 

collected from the paper for entry into the statistical 
field of the study record. The statistical information 
extracted may include p-values, mean values, standard 
deviations, population distributions, median values, 



WO 00/55751 



PCT/US00/06625 



- 31 - 

sensitivity, and specificity. Information on the study 
population, such as the size of the study population, 
is also extracted in this step. 

In step 250, a determination is made on the 
5 type of combination analysis to be used with the study. 
Certain combination analysis techniques, such as meta- 
analysis, may only be available if the proper 
statistical information is available from the paper. 
Meta-analysis, for example, may only be applied if the 

10 statistical information includes either p-values, means 
, and standard deviations, or population distributions. 

Finally, in step 251, a pointer to the 
completed study record in study table 37 of literature 
dataset 36 is sorted into other datasets, according to 

15 the study's output category. Database 22 may contain a 
dataset for each of the output categories to which a 
study may be assigned. Thus, for the exemplary 
prostate cancer system, database 22 would contain a 
staging dataset, an outcome dataset, a quality of life 

20 dataset, a complications dataset, and an alternatives 
dataset, in addition to the literature dataset. A 
reference to the study record is placed in a table in 
the appropriate dataset that associates each output 
category with all of the study records that address 

25 that output category. Thus, in the prostate cancer 
system, the staging dataset would contain a table 
containing references to all studies in literature 
dataset 36 having staging as their output category. 

The Treatments Dataset 
30 In addition to containing data extracted 

directly from medical literature, database 22 contains 
a dataset containing information on various treatments, 
and the rules (indications) that determine whether a 
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particular treatment is appropriate. This treatments 
dataset is used by the system during profile generation 
to determine which treatments are suitable for use by a 
particular patient- The rules that determine whether a 
5 particular treatment is appropriate are obtained from 
experts in the treatment of the disease being handled 
by the system. Alternatively, the rules in the 
treatment dataset may be altered for each individual 
patient, based on the patient's preferences, the rules 

10 employed by the patient's personal physician, or the 
rules employed by the patient's insurance carrier. 

The treatments dataset contains an 
indications table that contains the indications for 
each of the treatments. FIG. 9 shows the fields in the 

15 indications table of the treatments dataset in database 
22. Indications record 100 has fields for an 
identifier, a treatment ID, an indicator description, 
an indicator rule, a parameter ID, and a parameter 
type. 

20 Identifier field 101 contains a unique 

identifier for each record in the indications table. 
Fields in other tables that reference records in the 
indications table may use the values stored in 
identifier field 101 to point to a particular record in 

25 the indications table. 

Treatment ID field 102 contains the 
identifier of the treatment indicated by the conditions 
stored in the indications record. For example, if the 
indication relates to radical prostatectomy, treatment 

30 ID field 102 would contain an identifier for the 
radical prostatectomy treatment. 

Description field 103 contains a textual 
description of the indication. For example, if an 
indication for radical prostatectomy is that the 



WO 00/55751 



PCT/US00/06625 



- 33 - 

patient should have a life expectancy greater than ten 
years, description field 103 may contain the text "Life 
expectancy should be greater than 10 years." 

Parameter ID field 104 identifies the 
5 parameter that must be tested for the indication. 
Thus, if using the life expectancy indication for 
radical prostatectomy described, above, parameter ID 
field 94 would contain an identifier for the "life 
expectancy" parameter. Parameter type field 105 

10 identifies the type of the parameter, which may be 

either an input parameter, or a super-category value. 
If parameter type field 105 indicates that the 
parameter is an input parameter, then parameter ID 
field 104 will point to one of the input parameters. 

15 Otherwise, if parameter type field 105 indicates that 
the parameter is a super-category, then parameter ID 
field 104 will point to one of the super-categories. 
In the "life expectancy" example, parameter type field 
95 would indicate that the parameter is a super- 

20 category, since "life expectancy" is a super-category 
in the exemplary prostate cancer system. 

Rule field 106 contains the condition on the 
input parameter that must be satisfied for the 
indication to be positive. The condition is written in 

25 a computer-readable format. For the "life expectancy" 
example, the rule would be ">=10". Thus, if the life 
expectancy super-category has a value greater than or 
equal to ten, the condition will be satisfied, and this 
indication for radical prostatectomy will be positive. 

30 Table 4 shows a portion of the indications 

table from the prostate cancer system showing the 
indications for radical prostatectomy. As described in 
detail hereinbelow, during the process of preparing an 
individualized profile, the conditions . listed in the 
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indications table will be tested. If all of the 
indications shown in Table 4 are positive, then radical 
prostatectomy will be listed in the report as a viable 
treatment option. 
5 Many of the fields of the indications table 

may be implemented using pointers to records in tables 
that associate information with ID numbers, rather than 
using the information itself. For example, in a 
preferred embodiment, parameter ID field 104 may 

10 contain the ID number of the parameter being used in 

either input parameters table 38, or a table containing 
information on the super-categories (not shown) . Thus, 
the entry in Table 4 that uses the "General Health" 
input parameter contains the number "35," which is the 

15 unique identifier for the "general health" input 

parameter, as shown hereinabove in Table 2. A similar 
technique could be used for any of the fields in the 
table, except the identifier field. 

STAGE II: PROFILE GENERATION 

20 Once database 22 has been populated with 

sufficient data from studies, and the available 
treatments have been entered into the treatments 
dataset, the system may be made available to patients, 
for generating individualized profiles. Collection of 

25 information from patients and generation of profiles 

are interactive processes, and are preferably performed 
over the Internet, or through some other communications 
medium. 

Collection of Information from the Patient 
30 The first step in generating a profile is 

collecting information from the patient to build a 
patient input dataset. Referring to FIG. 10, a 
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preferred process of gathering information from the 
patient is described, in which a user interacts with 
the system of the present invention over the Internet 
to gather information. 
5 In step 260, the. user connects to the 

profiler system, and provides the system with basic 
information, such as his. or her name, account ID (if an 
account has already been established) , and payment 
information, such as a credit card number. When this 

10 information is entered, at step 261, the user is given 
a choice of forms to complete, to provide the system 
with the information that is needed to generate a 
profile. For the exemplary prostate cancer system, 
such forms may include a form for entering the results 

15 of blood tests, a form for entering the results of a 
doctor's exam, a form for entering the results of 
imaging workups, a form for entering demographic 
information, a form for entering information on quality 
of life issues, and a form for entering information on 

20 comorbid issues. 

When the user selects a form, the system 
generates and displays the selected form at step 262 by 
using a table in database 22 that has been constructed 
for each form. This table (not shown) contains the 

25 identifiers of each of the input parameters to be 

included in the form, and the order in which the input 
parameters are to be displayed in the form. For each 
of the input parameters, the system displays the name 
of the parameter (retrieved from name field 57 of the 

30 input parameter) , and an input box for the parameter, 
which may contain the current value (if any) of the 
input parameter. The input box is displayed in the 
form by executing the display code for the parameter, 
retrieved from display code field 61. If a value for 
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the parameter is displayed, it may be necessary to 
first execute the parameter's reconstruction code, 
retrieved from reconstruction code filed 63. This 
process is repeated for each parameter in the selected 
5 form. 

At step 263, the user enters values for the 
input parameters. For each input parameter value 
entered, the validation code for the parameter 
retrieved from validation code field 62 is executed. 

10 If the validation code indicates that the value entered 
is not valid, the value is rejected, and the user is 
asked to enter another value for that input parameter. 
Steps 261-263 are repeated until the user is finished 
entering data. At step 264, the data are stored in 

15 patient input dataset 110. 

FIG. 11 shows some example parameter inputs 
from a "Pathology" input form for the exemplary 
prostate cancer system. The parameter names in column 
117 of form 115 are retrieved from name field 57 of the 

20 input parameter records associated with the form. Each 
of the parameter names in column 117 forms a clickable 
link to a glossary definition explaining the parameter. 
When a user clicks on the parameter name, the glossary 
text for the parameter (retrieved from glossary term 

25 field 58) is displayed. If the user leaves the mouse 
pointer over one of the names in column 117, a short 
description of the parameter (retrieved from 
description field 58) is displayed. 

Some of the input fields in form 117, such as 

30 fields 119a, 119b, and 119c comprise pull-down lists of 
possible selections for an input parameter. These 
selections are retrieved from selections field 64 of 
the input parameter record. 
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Generation of the Output Dataset 
Referring to FIG. 12, a preferred method of 
generating an output dataset from patient input dataset 
110 is described. At step 270, the system iterates 
5 through each of the studies in literature dataset 36, 
to determine which studies may be applied to the input 
dataset. This is done by matching the information in 
patient input dataset 110 against the input parameters 
for each study (step 271). If values for all of the 

10 input parameters of a study are present in patient 

input dataset 110, the ID of the study is added to an 
"applicable studies" table (not show) in patient input 
dataset 110 (step 272) . Otherwise, if any of the input 
parameters for a study are not present in patient input 

15 dataset 110, the study is considered "unmatched", and 
the system preferably records the study's ID, the 
number of missing input parameters, a list of the 
missing input parameters, the output category of the 
study, and the size of the study population. This 

20 information is recorded in an "unmatched studies" table 
in patient input dataset 110 (step 273) , and is used to 
generate missing data reports . 

If the unmatched studies table is not empty, 
then, at step 274, a missing data report is generated. 

25 The missing data report preferably includes the names 
of the missing input parameters, and the number of 
studies for which each of the missing input parameters 
is needed and the total study population for those 
studies. Additionally, for each of the studies that 

30 could not be used due to a missing input parameter, the 
missing data report preferably lists the output 
categories of the study, the title of the study, the 
study population, and the required input parameters for 
the study. This information is sent to the patient, 
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In step 282, the system checks to see if the 
input parameter or super category value meets the 
indication rule. If so, the system marks the 
indication as being met (step 284) . Otherwise, the 
5 system marks the indication as not being met (step 
286) . 

When all the indications for a treatment have 
been determined, at step 288, the system stores the 
information in a treatment indications table (not 

10 shown) in patient output dataset 120. Treatments for 
which all of the indications were met are probably the 
best treatment options available to this patient. 
Treatments for which most of the indications were met 
also may be applied. Treatments for which most of the 

15 indications are not met are not deemed to be good 
treatment options for this patient. 

At step 290, when all the available 
treatments have been checked, the system generates a 
treatment indications report, which may be displayed to 

20 the patient. For each available treatment, the 

treatment indications report preferably includes a 
description of each indication (retrieved from 
description field 103 of the indication records) , the 
rule for each indication (from rule field 106) , the 

25 value of the input parameter or super category 
referenced by each indication, and whether th t e 
indication was met or not. Treatments in the treatment 
indication report are preferably sorted according to 
how many of the treatment indications were met, with 

30 treatments for which all or most of the indications 
were met appearing first. 
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Generating Treatment Outcomes and Scores 
Once the treatment options have been 
generated, the system applies the data in literature 
dataset 36 to the treatments to generate information on 
5 the likely outcome for each treatment. The process 
used to generate the outcome is similar to the process 
used to generate values .for the output parameters, and 
is described with respect to FIG. 14. 

At step 300, for each treatment, the system 

10 iterates through the studies in literature dataset 36 

that apply to that treatment (as indicated in treatment 
category field 49), and that have an output category 
related to outcome. For each study that meets these 
criteria, the system matches the study's input 

15 parameters against available values of input parameters 
supplied by the user, as well as values of output 
parameters and super categories (step 302) . 

At step 304, if all the input parameters are 
matched, the system applies any calculations or tables 

20 from the study to the values of the input parameters to 
generate values for the study's output parameters. 
Depending on the output calculations and output tables, 
this step may require complex computations to be 
performed, and may include application of advanced 

25 techniques such as neural networks to the values of the 
input parameters. The output parameter values are 
stored in patient output dataset 120 in a treatment 
outcome table (not shown) . 

When all of the studies for a treatment have 

30 been used to compute output parameter values, at step 
306, the system applies combination analysis to 
determine values for each of the super categories 
related to outcome. For the exemplary prostate cancer 
system, outcome super categories preferably include 



WO 00/55751 PCT/US00/06625 



- 42 - 

life expectancy, PSA Recurrence, Disease Free Survival 
(at six month intervals to five years), quality of 
life, and complications. 

At step 308, the outcome super category 
5 values are used to determine an overall treatment score 
for each treatment. This may be accomplished through 
any of a variety of methods, including taking a 
weighted average of the outcome values, applying rules 
to determine the score from the values, applying fuzzy 
10 sets to determine the overall score from the values, or 
by any other calculation method that derives a single 
score from numerous scores. Alternatively, an 
interactive method may be employed, such as displaying 
the super category values to the user, and asking him 
15 or her to rank the treatments based on the super 
category scores. 

At step 310, the information on the outcome 
super category values and overall treatment scores, as 
well as information on the studies applied for each 
20 treatment to generate the scores is stored in patient 
output dataset 120. 

At step 312, an outcome report is generated, 
and may be displayed to the patient. For each 
treatment, the outcome report preferably contains the 
25 treatment score, the values for the outcome super 
categories for the treatment, and information on 
individual experiences of other patients who have 
undergone the treatment. 

Finally, at step 314, the individualized 
30 profile is generated, and displayed or sent to the 

patient. In a preferred embodiment, the individualized 
profile preferably comprises an interactive web page 
that permits the patient to view the data in the 
profile, and to click on links to view, more detailed 
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information/ The individualized profile contains all 
of the reports described above, including the missing 
data report, the calculations report, the treatment 
indications report, and the outcome report. 
5 Additionally, the individualized profile contains 
patient-readable information on each of the studies 
applied (preferably available through links from a 
summary of the studies), and an * "executive summary", in 
which the super-category values for each category, and 

10 the applicability and outcome for each treatment are 
listed in a compact form. 

All of the information stored in the patient 
input dataset and the patient output dataset is stored 
on the system for a period of time. During this 

15 period, which may be as long as several years, the 

patient may change or update the information, and may 
generate updated reports or profiles. 

The personalized profile is intended to be 
used by a patient to augment information available from 

20 his or her physician, and is not meant to be used 
without a physician's advice. Once the profile is 
generated, the patient should discuss the profile with 
his or her physician. Based on this discussion, 
additional information may become available to the 

25 patient, who may provide this additional information to 
the system to generate updated profiles. 

FIG. 15 depicts an illustrative computer 
system and network on which the system of the present 
invention may be implemented. Internet server 140 

30 comprises a computer connected to the Internet via a 
high-speed connection, and is also connected to LAN 
141. Internet server 140 preferably runs a standard 
HTTP server application, such as Apache, which is 
available for free from the Apache organization at 
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"http://www.apache.org". Internet server 140 accepts 
HTTP connections from computers on the Internet, and 
sends web pages across the Internet to client 
computers, such as client computer 142. 
5 Internet server 140 also runs a variety of 

scripts (such as Java "servlets" or CGI scripts) to 
interact with users across the Internet, to dynamically 
build web pages, and to access data stored on database 
server 144. Most of the routines for interacting with 
10 a patient, and for generating an individualized profile 
based on information provided by the patient, are 
stored and executed on Internet server 140. 

Database server 144 comprises a computer 
system connected to LAN 141 that provides access to 
15 database 22, which is stored on RAID array 146. 

Database server 144 executes database software that 
permits other computers to access database 22 over LAN 
141 . 

LAN 141 may also be connected to additional 
20 computers 145, that may be used, for example, to enter 
data extracted from studies into database 22. Most of 
the functions that may be performed using computers 145 
connected to LAN 141 may also be performed over the 
Internet. 

25 Patients use a personal computer connected to 

the Internet, such as client computer 142, to access 
the system of the present invention. Client computer 
142 executes standard Internet browser software, such 
as Netscape Navigator, by Netscape Communications 

30 Corporation, of Mountain View, California. Client 

computer 142 uses the browser software to interact with 
Internet server 140 across the Internet, and to display 
web pages provided by Internet server 140 to the 
patient. The input forms generated by the system of 
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the present invention, as well as the reports and 
profile generated by the system are displayed to the 
patient by the browser software running on client 
computer 142. 

5 It should be understood that the network 

configuration discussed with reference to FIG. 15 is 
for purposes of illustration only. It would be 
possible, for example, to combine database server 144 
with Internet server 140. Additionally, database 22 
10 could be stored on a normal hard drive or other 

magnetic media, an optical disk, or in a distributed 
fashion on computers 145 on LAN 141, rather than on 
RAID array 146. The exact configuration of LAN 141, or 
the specific software and protocols used on the 
15 computers connected to LAN 141 all may be changed 
without departing from the present invention. 

It will be apparent to one skilled in the art 
that the above-described methods and apparatus have 
uses beyond providing patients with information. For 
20 example, doctors and clinicians may benefit from using 
the system of the present invention to assist them in 
advising patients. The information on medical research 
literature provided by the system may be especially 
helpful to medical professionals or students. 
25 Although preferred illustrative embodiments 

of the present invention are described above, it will 
be evident to one skilled in the art that various 
changes and modifications may be made without departing 
from the invention. For instance, although many of the 
30 examples refer to a system for generating profiles for 
prostate cancer patients, it will be understood that 
the above-described system may be applied to nearly any 
disease, depending on the availability of studies to 
build the medical database. Additionally, minor 
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variations of the structure of the database, or of the 
algorithms used to generate the profiles may be made 
without significantly affecting the overall structure 
or operation of the system. It is intended in the 
5 appended claims to cover all such changes and 

modifications that fall within the true spirit and 
scope of the invention. . 
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Prostate Cancer System E xample Input Parameters 



::: '- I . 3 ?:-V 


v -v ;•-.:! ! ■: ; : ; par aifce te r :;Wanve:..:0 ■ i 


1 


Prostate Specific Antigen 


2 


Clinical Stage 


3 


Primary Gleason Grade 


4 


Secondary Gleason Grade 


5 


Gleason Score 


6 


Birth Date 


-7 


Race 


15 


Percent Biopsies Positive 


16 


erMRI for ECE 


17 


erMRI for SVI 


18 


Systematic Biopsy 


19 


Total Number of Cores 


20 


Number of Cores with Cancer 


21 


Posterior Side 


22 


Anterior Side 


23 


Transitional Zone 


24 


Peripheral Zone 


25 


Perineural Invasion 


26 


Cancer Volume 


27 


Capsular Penetration 


28 


Seminal Vesicle 


30 


Free to Total PSA 


31 


PSA Date 


32 


cPSA 


33 


Potency 


34 


Continence 


35 


General Health 


36 


Ultrasound 


37 


Digital Rectal Exam 


38 


Prostatic Intraepithelial 
Neoplasia 


39 


Percent of Cancer in Biopsy 


40 


Biopsy Cancer Length 


42 


Body Weight 


44 


Life Preference 


45 


Potency Issues 





I ;. . arive ter./ Name;/ ' f -^i? ": 


47 


Height 


48 


Doctor Name 


49 


Doctor Fax 


50 


Prostatic Acid Phosphatase 


51 


Address 


52 


Address 2 


53 


City 


54 


State 


55 


Zipcode 


56 


Telephone Number 


57 


Lymph Nodes 


58 


Gleason Sum 7 
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Prostate Cancer System Example Super-Categories 





■-i-'siup^ •Naffie.;:;:.;' 


y-l - : : • •■' • • J)&s or iptxon ■ , : * : '■ ••; 


1 


Organ Confined 


Organ Confined 


2 


Locally Confined 


Locally Confined 


3 


Node Involvement 


Node Involvement 


0 4 


Distant Mets 


Distant Mets 


5 


Disease Free Survival 


Disease Free Survival 


6 


PSA Recurrence 


PSA Recurrence 


7 


Life Expectancy 


Life Expectancy 


8 


6 Month DFS 


6 Month Disease Free Survival 


9 


12 Month DFS 


12 Month Disease Free Survival 


10 


18 Month DFS 


18 Month Disease Free Survival 


12 


2 4 Month DFS 


24 Month Disease Free Survival 


13 


30 Montn utb 


_j U P10nt.il Ul 5cd CX.cc o <_i j, u - v ai. 


14 


3 6 Month DFS 


36 Month Disease Free Survival 


15 


4 2 Month DFS 


4 2 Month Disease Free Survival 


16 


4 8 Month DFS 


4 8 Month Disease Free Survival 


17 


5 4 Month DFS 


54 Month Disease Free Survival 


21 


60 Month DFS 


60 Month Disease Free Survival 



WO 00/55751 



-49- 

TABLE 3 



PCT/US00/06625 



Prostate Cancer System 





,":4; : :: : -; : OUtpU 


13 


12 Month DFS by CCV 


54 


12 Month DFS by Calculated 
Stage 


44 


12 Month DFS by Gleason 
Score 


34 


12 Month DFS by PV 


14 


18 Month DFS by CCV 


55 


18 Month DFS by Calculated 
Stage 


45 


18 Month DFS by Gleason 
Score 


35 


18 Month DFS by PV 


15 


2 4 Month DFS by CCV 


56 


24 Month DFS by Calculated 
Stage 


46 


2 4 Month DFS by Gleason 
Score 


36 


2 4 Month DFS by PV 


16 


30 Month DFS by CCV 


57 


30 Month DFS by Calculated 
Stage 


47 


30 Month DFS by Gleason 
Score 


37 


30 Month DFS by PV 


17 


3 6 Month DFS by CCV 


58 


36 Month DFS by Calculated 
Stage 


48 


36 Month DFS by Gleason 
Score 


38 


36 Month DFS by PV 


5 


3 Year Freedom from PSA 
Failure 


18 


4 2 Month DFS by CCV 


q 


4 2 Month DFS by Calculated 
Stage 


49 


42 Month DFS by Gleason 
S core 


39 


4 2 Month DFS by PV 


19 


4 8 Month DFS by CCV 


60 


48 Month DFS by Calculated 
Stage. 



e Output Parameters 



\VibV- 


output" : ;; ^^ah^j^i^a^ 


50 


4 8 Month DFS by Gleason 
Score 


40 


4 8 Month DFS by PV 


20 


54 Month DFS by CCV 


61 


54 Month DFS by Calculated 
Stage 


51 


54 Month DFS by Gleason 
Score 


41 


5 4 Month DFS by PV 


21 


60 Month DFS by CCV 


62 


60 Month DFS by Calculated 
Stage 


52 


60 Month DFS by Gleason 
Score 


42 


60 Month DFS by PV 


12 


6 Month DFS by CCV 


53 


6 Month DFS by Calculated 
Stage 


43 


6 Month DFS by Gleason 
Score 


33 


6 Month DFS by PV 


7 


Capsular Perforation 


1 


Capsular Penetration 


10 


Disease Free Survival 

ucya Li. vc JUL yit-etj. naiyxu^ 


1 1 


fl^caoc £ i. c t. O UJ. V 1 V a JL Wl t,Il 

Pos Surgical Margins 


6 


Extracapsular Extension 


9 


ECE and SVI 


4 


Lymph Node Involvement 


2 


Organ Confined 


3 


Seminal Vesicle Involvement 


8 


Tumor Localization 
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What Is Claimed Is: 

1.. A method of generating individualized 
medical profiles for patients, the method comprising: 

selecting medical literature for inclusion in 
a medical database, based on a set of predetermined 
inclusion criteria; 

extracting data from studies in the selected 
medical literature for addition to the medical 
database, the data extracted for each study including 
one or more input parameters, one or more output 
parameters, and one or more algorithms; 

compiling a set of input parameters 
comprising one or more input parameters extracted from 
each study, a set of output parameters comprising one 
or more output parameters extracted from each study, 
and a set of algorithms comprising one or more 
algorithms extracted from each study; 

collecting information from a patient to 
provide values for a subset of the set of input 
parameters; 

matching the subset of input parameters to 
the one or more input parameters for each study in the 
medical database to produce a set of applicable 
studies ; 

using a first subset of the set of algorithms 
corresponding to the applicable studies on the values 
of the subset of input parameters to produce values for 
a subset of the set of output parameters corresponding 
to the applicable studies; and 

generating an individualized medical profile 
based on the values of the subset of output parameters. 
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2. The method of claim 1, further 

comprising : 

adding data on treatments and treatment 
indications to the medical database; 

using the values of the subset of output 
parameters to determine which treatment indications are 
met; and 

generating a treatment indications report 
wherein the treatment indications for each treatment 
are listed, along with a mark showing whether each 
treatment indication was met, 

wherein generating the individualized medical 
profile further comprises including the treatment 
indications report in the individualized medical 
profile. 

3. The method of claim 2, further 
comprising : 

applying combination analysis to the values 
of the subset of output parameters to produce a set of 
combined super-category values, 

wherein using the values of the subset of 
output parameters to determine which treatment 
indications are met comprises using the set of combined 
super-category values to determine which treatment 
indications are met. 

4. The method of claim 3, wherein using the 
values of the subset of output parameters to determine 
which treatment indications are met further comprises 
using the values of the subset of input parameters to 
determine which treatment indications are met. 
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5. The method of claim 2, wherein adding 
data on treatments and treatment indications to the 
medical database comprises adding a rule to the medical 
database for each indication, the rule determining 
whether the treatment indication is met. 

6. The method of claim 5, wherein using the 
values of the subset of output parameters to determine 
which treatment indications are met further comprises 
using the rule for each treatment indication to 
determine whether the treatment indication is met. 

7. The method of claim 2, further 
comprising generating outcome information for each 
treatment, and including the outcome information in the 
individualized medical profile. 

8. The method of claim 7, wherein 
generating outcome information for each treatment 
comprises generating an outcome score for each 
treatment . 

9. The method of claim 7, wherein 
generating outcome information for each treatment 
comprises : 

determining which studies in the medical 
database are applicable to the outcome of a treatment; 
and 

using a second subset of the set of 
algorithms corresponding to the studies that are 
applicable to the outcome of the treatment to produce 
output values indicative of the outcome of the 
treatment . 
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10. The method of claim 7, wherein the 
outcome information is stored in an individualized 
patient output dataset in the medical database. 

11. The method of claim 2, wherein 
information on which treatment indications were met is 
stored in an individualized patient output dataset in 
the medical database. 

12. The method of claim 1, wherein values of 
the subset of output parameters are stored in an 
individualized patient output dataset in the medical 
database. 

13. The method of claim 1, wherein the first 
subset of algorithms comprise calculations or tables 
that map values of the subset of input parameters to 
values of the subset of output parameters. 

14. The method of claim 13, wherein the 
tables optionally represent neural networks. 

15. The method of claim 1, wherein matching 
the subset of input parameters to the one or more input 
parameters for each study further comprises: ■ 

compiling a list of unmatched studies, 
including each study for which the subset of input 
parameters does not match the one or more input 
parameters of the respective study; and 

using the list of unmatched studies to 
generate a missing data report. 
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16. The method of claim 1, wherein the 
method further comprises applying combination analysis 
to the values of the subset of output parameters to 
produce a set of combined super-category values. 

17. The method of claim 16, wherein the 
combination analysis comprises a technique chosen from 
a set consisting of meta-analysis, averaging, fuzzy 
logic, fuzzy sets, and interactive combination 
techniques . 

18. The method of claim 17, wherein the data 
extracted for each study includes statistical 
information, and the statistical information is used to 
determine which combination analysis technique is 
applied. 

19. The method of claim 1, wherein 
collecting information from the patient comprises: 

generating an input form having input fields 
for a plurality of input parameters from the set of 
input parameters; and 

extracting values for the plurality of input 
parameters from values entered by the patient into the 
input fields. 

20. The method of claim 19, wherein each one 
of the set of input parameters in the medical database 
includes display' code for displaying that input 
parameter, and generating the input form comprises 
executing the display code for each one of the 
plurality of input parameters in the form. 
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21. The method of claim 19, wherein each one 
of the set of input parameters in the medical database 
includes validation code for validating that input 
parameter, and extracting values for the subset of 
input parameters from data entered by the patient 
comprises executing the validation code for each value 
entered by the patient. . 

22. The method of claim 19, wherein each one 
of the set of input parameters includes an identifier 
for a form on which that input parameter should appear. 

23. The method of claim 1, wherein selecting 
medical literature for inclusion in the medical 
database further comprises: 

providing the medical literature to a review 
board including a plurality of reviewers; 

having each reviewer assign each study in the 
medical literature a score, .based on the predetermined 
inclusion criteria; and 

determining which studies should be included 
in the medical database based on the scores assigned by 
the reviewers. 

24. The method of claim 23, wherein 
determining which studies should be included comprises 
computing an average score for each of the studies, and 
including studies for which the average score exceeds a 
predetermined threshold. 

25. The method of claim 1, wherein the 
predetermined inclusion criteria comprise one or more 
of: criteria based on the objectives of the study, on 
the study population, on the description of the methods 
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used in the study, on the results of the study, on the 
statistical significance of the study, and on the 
ability to summarize the results of the study in the 
form of a calculation or table. 

26. The method of claim 1, wherein the data 
extracted for each study, further includes citation 
information, a patient readable abstract, statistical 
information, and information on the study population. 

27. A digital storage medium storing a 
medical database, the database comprising a literature 
dataset, containing information on selected medical 
literature, the literature dataset including: 

a study table that contains information on 
studies extracted from the selected medical literature, 
the study table storing a plurality of study records, 
each study record comprising a plurality of fields 
containing information on a study; 

an input parameter table that stores a 
plurality of input parameter records, each input 
parameter record comprising a plurality of fields 
containing information on an input parameter; and 

an output parameter table that stores a 
plurality of output parameter records, each output 
parameter record comprising a plurality of fields 
containing information on an output parameter. 

28. The digital storage medium of claim 27, 
wherein the fields of each study record comprise: 

an input parameters field that contains 
identifiers of records in the input parameter table for 
input parameters associated with a study; 
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an output parameters field that contains 
identifiers of records in the output parameter table 
for output parameters associated with the study; and 

an algorithms field that contains algorithms 
from the study that map values of the input parameters 
associated with the study to values of output 
parameters associated with the study. 

29. The digital storage medium of claim 28, 
wherein the algorithms field comprises a calculations 
field, containing calculations or tables that map 
values of input parameters to values of output 
parameters . 

30. The digital storage medium of claim 29, 
wherein the tables in the calculations field represent 
neural networks. 

31. The digital storage medium of claim 36, 
wherein the fields of each study record further 
comprise : 

a citation information field, which stores 
citation information, such as the author, title, 
publication date, and journal in which the study 
appeared; and 

an abstract field, which contains an abstract 
for the study. 

32. The digital storage medium of claim 28, 
wherein the fields of each study record further 
comprise one or more of: a statistical information 
field, that contains statistical information on the 
study; a study population field that stores information 
on the size of the study population; an output category 
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field that identifies the function of the output of the 
study; and a treatment category field that identifies 
the treatment that was applied to a study population. 

33. The digital storage medium of claim 21, 
wherein the fields of each input parameter record 
comprise a name field, containing the name of the input 
parameter, and a description field, containing a 
description of the input parameter. 

34. The digital storage medium of claim 27, 
wherein the fields of each input parameter record 
comprise : 

a display code field, containing display code 
that displays the input parameter when the display code 
is executed; and 

a validation code field, containing 
validation code that validates checks to see if a value 
for the input parameter is valid when the validation 
code is executed. 

35. The digital storage medium of claim 27, 
wherein the fields of each input parameter record 
comprise a form ID field, which identifies input forms 
on which the input parameter should appear. 

36. The digital storage medium of claim 21, 
wherein the fields of each output parameter record 
comprise a name field, containing the name of the 
output parameter, and a description field, containing a 
description of the output parameter. 
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37. The digital storage medium of claim 27, 
wherein the fields of each output parameter record 
comprise a super-category field, containing an 
identifier of the super-category into which values of 
the output parameter are combined. 

38. The digital storage medium of claim 27, 
wherein the medical database further comprises a 
treatment indications table, containing information on 
the indications for treatments, and wherein the 
treatment indications table stores a plurality of 
indication records, each indication record comprising a 
plurality of fields containing information on an 
indication for a treatment. 

39. The digital storage medium of claim 38, 
wherein the fields of each indication record comprise 
one or more of: a treatment ID field that identifies 
the treatment to which the indication pertains; a rule 
field that contains a rule that must be satisfied for 
the indication to be met; and a description field that 
contains a description of the indication. 

40. The digital storage medium of claim 21, 
wherein the medical database further comprises a 
patient input dataset that stores values of input 
parameters entered by a patient. 

41. The digital storage medium of claim 27, 
wherein the medical database further comprises a 
patient output dataset that stores values of output 
parameters and super-category values computed based on 
information provided by a patient. 
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42. A computer system for generating 
individualized medical profiles for patients, the 
computer system comprising a server storing a series of 
programmed routines, the computer system further 
comprising : 

a medical database containing information on 
studies extracted from medical literature, the 
information comprising a set of input parameters, a set 
of output parameters and a set of algorithms, each 
study having one or more input parameters, one or more 
output parameters, and one or more algorithms; 

a data collection routine that collects 
information from a patient to provide values for a 
subset of the set of input parameters; 

a matching routine that matches the subset of 
input parameters for which values are collected from 
the patient with the set input parameters to produce a 
set of applicable studies; 

a computation routine that uses algorithms 
from the applicable studies on the values of the subset 
of input parameters to produce values for a subset of 
the set of output parameters; and 

an output routine that generates an 
individualized medical profile based on the values of 
the subset of output parameters. 

43. The computer system of claim 42, wherein 
the medical database further comprises data on 
treatments and treatment indications from the medical 
database, the computer system further comprising: 

a treatment routine that uses the values of 
the output parameters to determine which treatment 
indications are met and generates a treatment 
indications report wherein the treatment indications 
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for each treatment are listed, along with a mark 
showing whether each treatment indication was met. 

44. The computer system of claim 43, wherein 
the treatment routine applies combination analysis to 
the values of the subset of output parameters to 
produce a set of combined super-category values and 
uses the set of combined super-category values to 
determine which treatment indications are met. 

45. The computer system of claim 43, wherein 
the treatment routine uses the values of the subset of 
input parameters to determine which treatment 
indications are met. 

46. The computer system of claim 43, wherein 
the medical database stores a rule for each treatment 
indication and the treatment routine uses the rule to 
determine whether the treatment indication is met. 

47. The computer system of claim 43, wherein 
the computer system further comprises an outcome 
routine that generates outcome information for each 
treatment, and the output routine includes the outcome 
information in the individualized medical profile. 

48. The computer system of claim 47, wherein 
the outcome routine determines which studies in the 
medical database are applicable to the outcome of a 
treatment and uses the algorithms from the studies that 
are applicable to the outcome of the treatment to 
produce output values indicative of the outcome of the 
treatment. 
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49. The computer system of claim 48, wherein 
the algorithms comprise calculations or tables that map 
values of input parameters to values of output 
parameters . 

50. The computer system of claim 49, wherein 
the tables optionally represent neural networks. 

51. The computer system of claim 42, wherein 
the computer system further comprises: 

a routine that compiles a list of unmatched 
studies, including all studies for which the 
information collected from the patient does not match 
the one or more input parameters of each one of the 
studies and uses the list of unmatched studies to 
generate a missing data report. 

52. The computer system of claim 42, wherein 
the computation routine further comprises a combination 
routine that applies combination analysis to the values 
of the subset of output parameters to produce a set of 
combined super-category values. 

53. The computer system of claim 52, wherein 
the combination routine performs combination analysis 
using a technique chosen from a set consisting of meta- 
analysis, averaging, fuzzy logic, fuzzy sets, and 
interactive combination techniques. 

54. The computer system of claim 52, wherein 
the combination routine accesses statistical 
information on the studies from the medical database 
and uses the statistical information to determine which 
combination analysis technique to apply. 
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55. The computer system of claim 42, wherein 
the data collection routine generates an input form 
having input fields for a plurality of input parameters 
and extracts values for the plurality of input 
parameters from values entered by the patient into the 
input fields. 

56. The computer system of claim 55, wherein 
each one of the set of input parameters in the medical 
database includes display code for displaying that 
input parameter, and the data collection routine 
generates the input form by executing the display code 
for each one of the plurality of input parameters in 
the form. 

57. The computer system of claim 55, wherein 
each one of the set of input parameters in the medical 
database includes validation code for validating that 
input parameter, and the data collection routine 
extracts values for the plurality of input parameters 
from data entered by the patient by executing the 
validation code for each value entered by the patient. 

58. The computer system of claim 55, wherein 
each one of the set of input parameters includes an 
identifier for a form on which that input parameter 
should appear. 
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